Calhoun 

iniutuiiaiul  Archive  Nil  vdl  Pat(<)radua(«  School 


Calhoun:  The  NPS  Institutional  Archive 
DSpace  Repository 


Theses  and  Dissertations 


Thesis  and  Dissertation  Collection 


1976-09 

Accuracy  analysis  for  a  lower  confidence  limit 
procedure  for  system  reliability. 


Gatliffe,  Thomas  Robert 


http://hdl.handle.net/10945/17653 


Downloaded  from  NPS  Archive:  Calhoun 


DUDLEY 

KNOX 

LIBRARY 


Calhoun  is  s  project  of  the  DudlEy  Knox  library  at  NPS,  furthering  the  precepts  and 
goals  of  open  government  and  government  transparency.  All  information  contained 
herein  has  been  approved  for  release  try  the  NPS  Public  Affairs  Officer. 

Dudley  Knox  Library  /  Naval  Postgraduate  School 
411  Dyer  Road  /  1  University  Circle 
MontereVr  California  USA  93943 


http://www.nps.8du/ljbrary 


ACCURACY  ANALYSIS  FOR 
A  LOWER  CONFIDENCE  LIMIT  PROCEDURE 
FOR  SYSTEM  RELIABILITY 


Thomas  Robert  Gatllffe 


NAVAL  POSTGRADUATE  SCHOOL 

Monterey,  California 


THESIS 


ACCURACY  ANALYSIS  FOR 
A  LOWER  CONFIDENCE  LIMIT  PROCEDURE 
FOR  SYSTEM  RELIABILITY 

by 

Thomas  Robert  Gatliffe 
September  1976 

Thesis  Advisor:  W.  M.  Woods 


Approved  for  pubitc  release;  distribution  unlimited. 


UNCLASSIFIED 


security  classification  of  this  RAOE  Dtm  Entmrmd) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  RERORT  NUMIER 

2.  GOVT  ACCESSION  NO* 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  fAnd 

Accuracy  Analysis  for  a  Lower  Confidence  Limit 
Procedure  for  System  Reliability 

S.  TYPE  OF  REPORT  A  PERIOD  COVERED 

Master's  Thesis 

Seotember  1976 

6.  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTMORfW 

Thomas  Robert  Gatliffe 

1.  CONTRACT  OR  grant  NUMBERfO 

'*■  PENFORMINO  ORGANIZATION  NAME  AnO  ADDRESS 

Naval  Postgraduate  School 

Monterey,  California  93940 

l6.  program  element.  PROJECT,  TASK 

AREA  A  WORK  UNIT  NUMBERS 

II.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

Naval  Postgraduate  School 

Monterey,  California  93940 

12.  NCPORT  DATE 

September  1976 

13.  NUMBEN  OF  PAGES 

98 

i4.  monitoring  agency  name  a  AOORESSi'I/ from  Contr^tUng  OUlcm) 

IS.  teCUPITY  CLASS,  (ol  Uil,  report; 

Unclassified 

IS«.  DECLASSIFICATIOn/OOWNGR  AGING 

SCHEDULE 

K.  OISTRISUTION  STATEMENT  ro<  lAi*  RAporO 

Approved  for  public  release;  distribution  unlimited. 

A 

17.  OlSTRlSUTION  STATEMENT  (oi  thm  obofrocf  mnt0rmd  in  Block  20,  ii  dHlcront  from  Rcpofi) 

Id.  SUPPLEMENTARY  NOTES 

IS.  KEY  WORDS  (Continue  on  rororoo  cido  it  ncccmcmy  ond  idontlfjr  by  block  numbor) 

System  Reliability 

Lower  Confidence  Limit 

Log-Gamma  Method 

Reliability  Simulation 

20.  ABSTRACT  fContImio  on  rovoroo  cldo  H  ncccmcmy  mtd  Idonlify  by  block  n%mtboe) 

This  thesis  examines  a  proposed  empirical  method  for  determining  the 

100  (l-<x)  %  lower  confidence  limit  for  the  reliability  of  a  system  composed 
of  a  mixture  of  series  and  parallel  connected  components  for  which  only 
component  level  test  data  is  available.  The  method  is  an  extension  of  the 
Log-gamma  procedure  originally  proposed  for  series  connected  systems  only. 

The  accuracy  of  the  method  is  assessed  for  some  representative  system 
reliability  constructs  using  a  computer  simulation  procedure.  The 

DD  I  1473  EDITION  OF  I  NOVS»ISO«fOLETe  UNCLASSIFIED 

(Page  1)  S/N  0102-014-6601  1 


SECURITY  CLASSIFICATION  OF  THIS  RAOC  Dmtm 


UNCLASSIFIED 


iuCU>yiTV  CU  ASStFlC  ATION  OF  THIS  P*GErW>i»n  n^tm  Entmemd 


20.  (Continuation  of  Abstract) 

simulation  results  are  examined  with  a  view  toward  identification  of 
accuracy  indication  parameters  which  may  be  estimated  prior  to  the 
component  tests. 


DD  Form  1473 
,  1  Jan  73 

S/N  0102-014-6601 


UNCLASSIFIED _ 

security  classification  of  This  FACE(TFh«n  Oaia  Enfrmd) 


2 


ACCURACY  ANALYSIS  FOR  A  LOWER  CONFIDENCE  LIMIT  PROCEDURE 

FOR  SYSTEM  RELIABILITY 


by 


Thomas  Robert  Gatliffe 
Lieutonant-Commander,  Ohited  States  Navy 
B.S.,' United  States  Naval  Academy,  1965 


Submitted  in  partial  fulfillment  of  the 
requirements  for  the  degree  of 


MASTER  OF  SCIENCE  IN  OPERATIONS  RESEARCH 


from  the 


NAVAL  POSTGRADUATE  SCHOOL 
September  1976 


.3UULEY  KfJOX  LIbKARY 
f*AYAL  POSTGRADUATE  SCHGOC 
AflONfEREY,  CALIFORNIA  23940 


ABSTRACT 


This  thesis  examines  a  proposed  empirical  method 
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I.  introduction 


often,  in  the  design  and  production  of  complex  systems, 
an  important  question  to  be  answered  early  in  the  process 
concerns  the  demonstrable  system  reliability  based  upon 
observed  mission  test  results.  Usually  only  components  and 
minor  subassemblies  can  be  tested  in  any  but  the  very  latest 
stages  of  production.  For  reasons  of  prototype  cost,  the 
lack  of  complete  systems  for  early  tests,  the  expense 
involved  in  total  system  operational  tests,  and  the  need  to 
make  production  decisions  as  early  as  feasible,  reliance 
must  be  shifted  to  the  component  test  results  to  provide  at 
least  an  approximate  answer  to  this  question.  Component 
data  must  be  used  in  spite  of  the  moderately  strong 
assumptions  needed  to  transform  such  test  results  into  an 
estimate  of  overall  system  reliability. 

Since  estimates  are,  by  their  nature,  inexact,  it  would 
be  reasonable  to  expect  that  the  most  credible  estimate 
would  be  one  which  was  both  conservative  and  carried  with  it 
an  indicator  of  the  degree  of  conservatism  associated  with 
its  computation.  This,  of  course,  is  a  description  fitting 
a  lower  confidence  limit  when  referring  to  estimates  of 
system  reliability.  Thus,  when  one  speaks  of  a  "100(1-a)% 
lower  confidence  limit”  and  obtains  a  value  for  it,  the 
assertion  is  that  the  obtained  lower  confidence  limit  value 
is  less  than  the  actual  system  reliability  with  probability 
1-ci. 


In  1968,  J.  R.  Borsting  and  W.  M.  Woods  developed  what 
is  known  as  the  Log-Gamma  method  for  computing  lower 
confidence  limits  for  system  reliability  based  upon 
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component  mission  test  results  only  [Ref.  1],  As  originally 
developed,  the  Log^^Gamma  method  was  restricted  to  systems 
composed  of  all  series  connected  components.  It  did, 
however,  offer  the  advantage  of  allowing  for  unequal  sample 
sizes,  so  the  number  of  component  tests  could  vary 
arbitrarily  from  component  to  component  without  degrading 
the  procedure  accuracy.  In  addition,  no  assumption  is 
needed  concerning  the  failure  distribution  of  any  component. 

Woods  has  recently  proposed  a  modification  to  the 
procedure  which,  it  was  hoped,  would  extend  its  application 
to  a  mixed  system  of  series  and  parallel  connected 
components.  The  purpose  of  this  study  is  to  assess  the 
accuracy  of  the  revised  procedure  when  applied  to  some 
typical  component  failure  data  from  several  representative 
series  and  series- parallel  systems.  An  attempt  is  also  made 
to  discern  parameters  (constructed  from  or  inherent  to  the 
sample  data,  component  reliability  goals,  testing  plan,  and 
system  design)  which  could  provide  useful  indicators  of  the 
expected  accuracy  of  the  procedure. 
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II.  THE  PROCEDURAL.  MODEL 


It  should  be  noted  that  two  rather  strong  assumptions 
need  to  be  made  with  respect  to  system  and  component 
reliabilities.  First,  it  must  be  assumed  that  component 
tests  were  conducted  in  a  test  environment  not  unlike  that 
encountered  in  the  system  operational  mission  environment 
profile.  Second,  no  component  reliability  degradation  will 
result  from  interactions  with  other  components  when 
assembled  into  the  system.  The  degree  to  which  these  two 
assumptions  are  met  will  have  an  unknown  but  potentially 
great  effect  upon  the  validity  of  the  model  and  indeed  upon 
the  whole  concept  of  system  reliability  prediction  from 
component  attributes  data. 


A.  DEVELOPMENT  FOR  SERIES  SYSTEMS 


This  section  gives  a  modified  and  elaborated  development 
of  the  basic  reliability  model  and  estimation  procedure 
based  upon  that  presented  by  Woods  and  Borsting  [Ref.  1]. 

For  a  system  of  k  components  in  logical  series,  the 
system  reliability,  Rs,  can  be  expressed  in  terms  of  the 
individual  component  reliabilities  as  the  product 

Rs  =  IT  Pi  (2. 1) 
i=1 

where  Pi  is  the  true  reliability  of  the  i-th  component. 
From  Pi  the  component  unreliability,  Qi,  is  defined  as 


9 


Qi  =  1-Pi. 


Taking  the  natural  logarithm  in  equation  {2. 1)  and 
defining  the  new  variable,  S: 

k 

S  =  -InRs  =  -  E  In(l-Qi)  (2.2) 

•  i=1 

The  natural  logarithm  can  be  expanded  by  the  infinite  series 
In  (1-X)  =  -  E 

j=1 

S  =  .E  ,E  (Qi?/j  (2.3) 

1=1  3=1 

k 

S  =  E  [ Qi  +  Qi2/2  +  Qi3/3  +  ...] 
i=  1 

For  Qi  small,  say  0.1  or  less,  the  above  series  may  be 
approximated  by  the  first  two  terms  with  a  maximum  error  of 
0.34%  of  the  true  value.  Thus, 

k  k 

S  =  E  [Qi  +  Qi2/2]  =  E  Ti  (2.4) 

i=1  i=1 

where  Ti  =  Qi  +  Qi2/2.  For  the  remainder  of  the 

derivation  this  approximation  is  treated  as  an  equality. 

Appendix  A  derives  an  unbiased  estimator,  Ti,  for  Ti: 

Ti  =  AiQi  +  Bi[Qi2]/2  (2.5) 

where  Ai  =  [  2Ni-3  ]/[  2Ni-2  ] 

Bi  =  Ni/[Ni-1 ] 

Qi  =  Fi/Ni 

and,  ^  Fi  is  the  number  of  failures  resulting  from  Ni 

mission  tests  conducted  on  the  i-th  component. 

An  unbiased  estimator  of  S  will  be  obtained  from 


(X 


for  0<X<1 
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S  =  5;  Tl 

i=  1 


(2.6) 


S  will  be  an  unbiased  estimator  of  S,  since  it  is  the  sum  of 

A. 

the  unbiased  estimators,  Ti,  of  Ti. 

Appendix  B  shows  that,  for  the  reasonably  expected  range 
of  values  for  Qi  and  Ni,  the  variance  of  S  may  be 
approximated 

-  k  k 

Var[S]  =  i:  Var[Ti]  z  [  Ti/Ni  ]  (2.7) 

i=1  i=1 


By  intuitively  assuming  the  probability  distribution  of 
S  is  of  the  gamma  type  with  parameters  r  and  0,  an 
expression  can  be  derived  for  a  confidence  interval  for  Rs. 


) 


The  gamma  probability  density  may  be  written  as 


f.  (x,r,e)  =, 


r-1  -x/0 
-X  e 


x>0 


x<0 


(2.8) 


with  mean  =  r0  and  variance  =  r©^. 


To  determine  the  values  of  r  and  0,  the  following 
relationships  are  established: 

E[S]  =  r0  from  Eg.  (2.8) 

k 

E[§]  =  E  Ti  from  Eg.  (2.4) 
i=1 


Var[S] 

Var[S] 


=  r02  from  Eg.  (2.8) 

_  k  Ti 
i=1  Ni 

may  be  solved  simultaneously  to 


yield  the 


1 1 


These  eguations 


following  expressions  for  r  and  9: 


r  = 


k  12 
Z  Ti 

i  =  1 


k  Ti 

z  — 

i=1  Ni 


and  9  = 


k  Ti 
Z  — 
i=l  Ni 

~k 

Z  Ti 
i=1 


and  an  estimator,  r,  for  r  would  be 


i=1  Ni 


(2.9) 


Note  that  for  S  distributed  as  gamma  (r, 9),  2S/9  will  be 
distributed  as  chi-sguare  with  2r  degrees  of  freedom  [Ref. 
2,  p.  181].  The  following  probability  statements  can  then 
be  made: 


(2. 10) 


Since  9  =  E[S]/r  from  Eg.  (2.8)  and  E[S]  =  -InRs  from 

Eg.  (2.2), 


1  "a 


1-a 


j’-lnRs 

2S  1 

1  r  -  •> 

J2  J 

)C2r,1-a  ■* 

PI  InRs  < 


-2rS 


^2r,1-a  • 


Thus  the  100(1- a)%  lower  confidence  limit,  Rs*<ci>,  for  Rs 
is 


Rs*< 


(2.11) 
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A  100 {1-a  )%  lower  confidence  limit  estimate,  for  Rs 

would  be 


Rs*<  a) 


exp 


-2rS 


2. 

2r, 1-a 


■] 


(2. 12) 


The  primary  difficulty  this  formulation  presents  lies  in 
the  non-integer  nature  of  values  for  2r  as  defined. 
Although  some  computer  routines  are  available  to  approximate 
chi-square  values  with  non-integer  degrees  of  freedom,  most 
users  would  find  such  a  requirement  difficult  to  fulfill  at 
least.  Therefore  2r  is  replaced  with  the  expression 
[ 2r  ]  =  smallest  integer  >  2r 

This  is  justified  by  noting  that  the  ratio  of  the  chi-square 
value  divided  by  its  number  of  degrees  of  freedom  varies 
slowly  with  changes  in  the  degrees  of  freedom  for  values  of 
degrees  of  freedom  greater  than  about  five.  Further,  since 
2r  may  be  changed  moderately,  by  up  to  1.0,  without  great 
change  in  the  ratio  value,  it  is  reasonable  to  expect  that 

the  probability  distribution  of  [2r\/^  ^  has  small 

^^[2r],1-a 

variance.  This  expression  can  be  subsittuted  into  equation 


(2. 12)  to  yield 

=  exp 


[2r],1-a  J 


(2.  13) 


Since  the  computer  routines  available  for  this  research 
included  the  capability  of  computation  of  chi-square  values 
with  non-integer  degrees  of  freedom,  some  simulation  runs 
were  performed  using  both  equations  (2.12)  and  (2.13)  for 
comparison.  The  results  indicated  that  the  effects  were 
limited  to  the  third  decimal  place  at  worst  and  thus  had 
little  significance  with  respect  to  the  procedural  accuracy. 
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B.  REVISION  FOR  SERIES-PARALLEL  SYSTEM 


Preceding  from  the  strictly  series  system  procedure 
developed  above,  the  principal  revision  for  the  mixed 
series-parallel  system  procedure  was  to  redefine  fi  and  r  as 
follows: 


-  Fi  Fi2 

.  , Ai —  +  Bi - 

Ti  =  </  Ni  2Mi2 

.(1-Ri)  +  (1-Ri)2/2 


i=1,2, . . . ,K1 
i=Kl+l,. . . ,K2 


(2.  14) 


r 


max 


1.0, 


■K1+K2  .  1 
Z  Ti 
i=1 


2 


K1+K2  Ti 
E  — 
i=1  Ni  J 


(2. 15) 


K1+K2  . 

S  =  E  Ti  (2. 16 

i=1 


where  Ai ,  Bi,  Fi,  and  Ni  are  defined  as  before 
K1  is  the  number  of  series  components 
K2  is  the  number  of  series-parallel  subassemblies 
interconnected  in  series 

A. 

Ri  is  the  reliability  point  estimate  for  the  i-th 
subassembly  determined  in  the  usual  manner  from  the 
individual  point  estimates  for  the  subassembly  components  as 
derived  from  the  raw  failure  data. 


Although  some  comparison  runs  were  made  using  Ai  and  Bi 
coefficients  for  the  subassembly  contribution  to  S,  no 
significant  improvement  in  accuracy  was  noted  and  the  use  of 
these  coefficients  in  this  manner  was  abandoned  due  to  the 
difficulty  of  computation  with  varying  sample  sizes  within  a 
subassembly. 
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c. 


SPECIAL  CIRCUMSTANCES 


In  the  event  of  no  failures  in  any  components  or  a'  lack 
of  sufficient  failures  in  subassembly  components  such  that 
the  basic  procedure  yields  an  S  value  of  zero  and,  thus,  a 
system  reliability  lower  confidence  limit  estimate  of  one, 
an  alternate  approach  must  be  employed. 

Statistically,  the  optimum  solution  might  be  to  continue 
testing  until  sufficient  component  failures  have  been 
observed  such  that  the  above  conditions  no  longer  exist. 
However,  such  a  solution  might  also  not  be  economically 
feasible.  Therefore,  the  simulation  included  provision  for 
an  alternate  procedure  when  S  equals  zero  at  the  end  of  the 
programmed  number  of  tests  on  all  components.  In  addition, 
several  cases  were  included  where  such  conditions  would  be 
expected  to  exist  in  a  significant  number  of  the  simulation 
runs,  in  order  to  observe  the  efficacy  of  the  alternate 
procedure. 

The  derivation  of  this  alternate  procedure  is  given  in 
Appendix  C.  The  procedure  may  be  summarized  as  follows: 

(i)  Find  the  series  component  or  subassembly  with  the 
smallest  actual  or  equivalent  number  of  trials,  N  or  N*, 
respectively.  (See  section  IV.B.1) 

(ii)  Change  the  number  of  component  or  subassembly 
failures  to  F’  by  the  following  scheme: 


a 

F' 

0.2 

0.37 

NOTE:  For  best 

results,  N  or 

0.  1 

0.25 

N’  should  be  at 

least  10. 

0.05 

0.16 
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If  a  subassembly  was  selected,  treat  the  subassembly  as  a 
component  with  F*  failures  out  of  N'  mission  trials  for  the 
remainder  of  this  prpcedure. 

(iii)  Recompute  the  lower  confidence  limit  estimate 
using  the  basic  log-gamma  procedure  with  the  revised  failure 
data.  This  estimate  is  approximately  equivalent  to  a  raised 
to  the  1/N  power  as  explained  in  Appendix  C. 
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III.  THE  SIMUL^ION 


k.  PROCEDORE 


l 

The  computer  simulation  program  is  listed  in  Appendix  P. 
The  following  procedure  was  incorporated  into  the  program: 

•Step  One:  Initialize  and  read  in  values  for  the  total 
number  of  components  in  series,  K1,  the  number  of 
subassemblies  in  series,  K2,  the  number  of  components  within 
each  subassembly,  the  number  of  tests  performed  upon  each 
component,  Ni,  the  true  reliability  of  each  component,  Ri, 
and  the  seed  value  for  the  random  number  generator. 

Step  Two:  For  each  component  in  turn,  generate  the 
observed  number  of  failures  as  a  binomially  distributed 
random  variable,  Fi,  with  parameters  Ni  and  (1-Ri) . 

Step  Three:  Compute  Ti  for  each  series  component  and 
subassembly,  S  from  the  sum  of  the  Ti,  and  r  according  to 
equations  (2.14),  (2.15),  and  (2.16)  respectively. 

Step  four:  Compute  the  resulting  estimate  of  the 
100(1-  a )^  lower  confidence  limit,  R*<“),  according  to 
equation  (2.13)  for  representative  values  of  alpha  and  store 
each  estimate  in  a  vector  array  of  estimates.  Alpha  values 
used  in  this  study  were  0.20,  0.10,  and  0.05. 

Step  Five:  Repeat  Steps  Two  through  Four  until  the 
three  vector  arrays  of  estimates  corresponding  to  the  three 
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different  alpha  values  ace  1000  values  in  length. 

Step  Six:  Order  the  elements  of  each  vector  array  from 
low  to  high  and  determine  the  sample  mean  and  standard 
deviation. 

Step  Seven:  Compute  the  true  system  reliability,  Rs, 
from  the  input  component  reliabilities. 

Step  Eight:  Extract  the  100  (1-a)  percentile  value  from 
the  corresponding  array  and  compare  with  the  true  system 
reliability.  If  the  estimation  procedure  is  accurate  these 
two  values  should  agree.  If  agreement  does  not  occur,  the 
differences  should  be  small,  preferably  conservative,  and, 
hopefully,  can  be  made  to  converge  toward  zero. 

Step  Nine:  Output  all  data  which  was  input  in  Step  One 
in  order  to  insure  against  input  error.  Output  starting  and 
ending  random  number  generator  seed  values.  Output  true 
system  reliability,  100  (l-a)  percentile  values,  differences 
from  true  reliability,  sample  means  and  standard  deviations, 
and  various  percentile  values  of  interest.  Provision  is 
made  in  the  program  for  output  of  all  of  the  sample  values 
both  before  and  after  ordering,  if  the  user  desires. 

Step  Four  was  performed  in  two  different  ways  for  four 
of  the  cases  where  there  was  a  high  frequency  of  runs 
without  failures,  called  'null  runs'  in  the  output.  The 
normal  way  of  handling  this  problem  was  to  discard  that  run 
data  and  repeat  it  from  step  one.  Thus  the  complete  arrays 
contained  estimates  from  only  those  runs  which  had 
sufficient  failures  for  the  procedure  to  be  valid  without 
the  special  circumstances  modification  discussed  in  Section 
II. C.  In  order  to  observe  the  effect  of  utilizing  the 
modification,  however,  cases  18  through  21  were  repeated  as 
cases  30  through  33  with  the  alternate  procedure  invoked 
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whenever  S  equalled  zero  at  the  end  of  step  three. 

Three  proprietary  routines  were  utilized  in  the  program 
and  are  therefore  not  reproduced  in  the  program  listing. 
These  routines  were  used  to  obtain  the  binomially 
distributed  random  variables,  the  chi-square  function 
values,  and  to  sort  the  estimate  arrays  [Ref.  4]. 


B.  DESCRIPTION  OF  THE  CASES 


1 .  General 

The  cases  chosen  for  simulation  represent  three 
different  configurations;  a  series  of  components  connected 
in  series  with  a  series  of  simple  series-parallel 
subassemblies  of  components,  a  strictly  series-connected 
system  of  components,  and  a  system  which  incorporates  two 
somewhat  unusual  but  representative  "real-world"  subassembly 
reliability  relationships.  The  first  configuration  was 
chosen  to  demonstrate  the  general  performance  of  the  revised 
estimation  procedure  with  a  moderately  complex, 
series-parallel  system.  The  second  configuration  consisted 
primarily  of  some  cases  which  had  previously  been 
investigated  for  the  original  Log-gamma  procedure  [Ref.  1  ]. 
Since  the  revised  procedure  varied  somewhat  from  the 
originally  developed  version  in  the  treatment  of  the  wholly 
series  system,  a  comparison  was  desirable  in  order  to 
ascertain  whether  significant  effects  had  occurred  in  the 
procedure  accuracy.  The  third  configuration  was  chosen  to 
observe  the  robustness  of  the  procedure  when  applied  to  a 
much  more  complex  system  which  is  not  easily  reducable  to  a 
simpler  series-parallel  reliability  representation. 
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In  general,  the  simulated  number  of  tests  was  the 
same  for  each  component  within  each  case.  However,  this 
number  was  varied  among  cases  with  the  same  true  system 
reliability  in  order  to  identify  its  effect  upon  the 
procedure  accuracy.  The  two  exceptions  were  case  13  wherein 
the  number  of  tests  varied  from  component  to  component  and 
case  14  for  which  only  one  value  of  simulated  component 
tests  was  used  without  any  corresponding  cases  with 
different  numbers  of  tests. 


2.  Cases  One  Through  Twelve 


a.  Reliability  Block  Diagram 


*-[  01  |-[~02~|-  ••• 


b.  Test  Parameters 


(1)  Num^r  of  Component  Tests^  'tJi. 


Cases 

_Ni 

01, 

1 

o 

O 

10 

20 

i=1,2,. . . ,32 

02, 

05,  08, 

11 

50 

i= 1 ,2,. ..,32 

m 

o 

06,  09, 

12 

100 

i=1 ,2 ,. . . ,32 

20 


and  Ri 


(2)  Tru®  System  and  Com£onent  Reliabilities ,  Rs 


Cases _  _ Rs 


01, 

02, 

03 

.87559 

04, 

in 

o 

06 

.79984 

07, 

o 

00 

09 

.79167 

10, 

11, 

12 

.72317 

Ri_ 

995 

i— 1,2,. 

..  ,20 

950 

i=2 1  , . . 

.,32 

995 

i=1,2,. 

..  ,20 

900 

i=21  ,. . 

.,32 

990 

i— 1,2,. 

..  ,20 

950 

i=21  ,. . 

.,32 

990 

i=1,2,. 

..  ,20 

900 

i=21  ,. . 

.,32 

2 •  Case  Thirteen 

a.  Reliability  Block  Diagram 


b.  Test  Parameters 


i 

_Ni 

_Ri_ 

_i 

•HI 

t 

_Ri_ 

_i 

_Ri_ 

1 

150 

.995 

7 

28 

.967 

13 

59 

.682 

2 

90 

.985 

8 

125 

.995 

14 

5 

.729 

3 

75 

.979 

9 

63 

.970 

15 

5 

.729 

4 

100 

.988 

10 

125 

.995 

16 

5 

.729 

5 

125 

.982 

11 

59 

.682 

17 

19 

.536 

6 

18 

.980 

12 

59 

.682 

18 

19 

.536 

Rs: 

0. 

72329 

19 

19 

.536 

21 


Discussion 


c. 


This  case  corresponds  to  Case  No.  1  of  reference 
1.  The  only  change  was  to  replace  the  last  three  components 
each  with  three  components  in  parallel  with  a  subsystem 
reliability  equivalent  to  the  reliability  of  the  replaced 
component. 


4.  Cases  Foj|rtegn  Through  Twenty-one  and  Thirty  Through 
Thirty-three 


a.  Reliability  Block  Diagram 


•  •  • 


b.  Test  Parameters 


(1)  Number  of  Component  TestSj^  Ni. 


_ Cases 

_Ni 

14 

20 

i=1 , 2 , . .  . ,  15 

15,  18, 30 

25 

i=1 ,2,. . . ,25 

16,17,31 

50 

i=1,2,. . . ,25 

17,20,32 

100 

i  =  1 ,2, ,25 

21,33 

200 

i=1,2,...,25 

22 


(2)  True  Sis tern  and  Component  Reliabilities,  Rs 

and  Ri« 


_ Cases _ 

_ Rs _ 

’.995 

i  =  1 , 2, .  . .  ,  14 

1  4 

.79239  - 

.  850 

i=15 

15,16,17 

.88222 

.995 

i=1 ,2,.  .. ,25 

18,19,20,211 
30, 31 , 32,33j 

.97530 

.  999 

i=1 ,2,. .. ,25 

c.  Discussion 

These  cases  correspond  to  several  cases  from 
Ref.  1  with  the  exception  of  cases  21  and  33  of  the  present 
study.  These  were  added  when  it  was  noted  that  a  large 
number  of  runs  with  zero  failures  were  being  observed  with 
as  many  as  100  tests  on  each  component.  Cases  30  through  33 
are  identical  with  cases  18  through  21.  They  are  identified 
as  separate  cases,  since  a  slightly  different  procedure,  as 
described  in  section  III. A,  was  followed  in  their 
simulation. 
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Cases  Twenty~two  Through  Twenty-nine 


a.  Reliability  Block  Diagram 


•••  -  20  - 


22 


23 


25 


— |~29l-r30 


26  -1 


33 


34  J 


In  logical  series  with 


3  5  |-|~3^  37  |-|  38  [-j-[~38~|-) 


38 


c 


39 


-^4. 


35  [-  36  |-pr2~|--prr~|-^  43^ 


-  44 

f 


+  4- 


39 


;4;^ 


39 


39  i-r^^o~i-i  h' 


In  logical  series  with 


b.  Test  Parameters 


(1)  Number  of  Component  Tests,  Ni. 


Cases 

Ni 

22,26 

20 

i=1,2 

23,27 

25 

i=1,2 

24,28 

50 

i=1,2 

25,29 

100 

i=1,2 

,60 

,60 

,60 

,60 
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(2)  True  ^stem 

and  Ri_^ 

Cases _ 

22 

through 

29 

22  to  25 

26  to  29 


c.  Discussion 


and  Com£onen_t  Reliabilities ,  Rs 


Rs _  Ri 


.999 

i=1 ,2  , .  .  .  ,26 

.886 

1=21 , 28 , . . . ,32 

(See 

below) 

.900 

i=33,34 

1 

.999 

i=35,  36, .  . .  ,4  1 

.  .990 

i=42, 43,44 

j 

1 

-J. 

II 

1 

.87306 

(.995r  - 

_i=45, 46,  .  . .  ,60 

1 

-J. 

II 

1 

.83293 

(.990r  - 

i=45, 46, ... ,60 

The  second  and  third  subassembly  reliability 
diagrams  above  were  drawn  from  the  Lockheed  Reliability 
Evaluation  Plan  for  the^rrident  Missile  [Ref.  3]. 

In  the  second  diagram,  component  44  and  both 
components  41  must  operate  successfully  for  system  success. 
An  additional  feature  of  this  design  is  the  capability  of 
obtaining  successful  functioning  of  component  44  by 
following  a  logical  path  through  component  39  and  continuing 
in  a  reverse  direction  to  reach  component  44  from  the 
opposite  side  of  the  diagram,  if  necessary.  This  capability 
is  illustrated  with  double  arrows  to  indicate  that  the 
logical  success  path  may  be  traced  in  either  direction  for 
that  portion  of  the  reliability  diagram.  Note  also  that 
identically  numbered  components  are,  in  fact,  separate 
components  but  identical  in  operation.  Therefore,  component 
test  results  for  a  particular  component  type  are  assumed  to 
be  equally  applicable  to  all  components  of  that  type, 
regardless  of  the  specific  application.  The  reliability 
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equation  for  this  portion  of  the  diagram,  as  adapted  from 
reference  3,  is  as  follows: 


R 


=  M  TTILM  [1-  (1--M  )  (1-L  M  )  1 

SS  4  L  1  2  3  3  3  '•  '  l'  '  Z  T. 

+  (1-T  )  L  L  L  T  M  [1  -  (1-M  )  (1-T  M  )  ]! 

112333'-  '  z  '  Zl'-'j 

+  (1-M  )rMMMTTLL  [1-  (l-T  )  (1-L  )  ] 

4  C1232323'-  l''  l'-* 

+  (1-H  )  MMTTTLLL 

1  23123123 


(■  i- 


+  (1-M  )  MMTTTLLlI 

2  1312312  3j 


where  T  =  R  R  R  R 

1  35  36  37  33 

I 

T  =  R  i  R 

2  33  3  9 

T  =  R  R  R 

3  394041 

L  =  R  R  R  R 

1  35  364243 

L  =  R  R 

2  4  3  3  9 


M  =  R 

1  3  3 

M  =  R 

2  4  3 

M  =  R 

3  4  4 

M  =  R 

4  3  9 

L  =  T 

3  3 


(3.1) 


The  third  subassembly  diagram  illustrates 
another  type  of  reliability  problem  in  that  the  subassembly 
reliability  is  defined  in  Ref.  3  as  follows: 

^0 

1  R 

R  =  i=45  i 
SS 
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Although  these  diagrams  represent  current 
systems,  the  reliability  values  chosen  bear  no  intentional 
relation  to  actual  values  other  than  that  acquired  when 
choosing  them  on  a  criteria  of  reasonableness.  Therefore 
the  values  used  are  not  classified. 
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IV.  resolts  and  conclusions 


A.  SIMULATION  RESULTS 


The  simulation  output  is  listed  in  detail  in  Appendix  D 
for  each  run.  Each  case  was  simulated  three  times  with 
different  random  number  generator  seed  values  to  insure 
against  the  occurrence  of  non-representative  singularities 
in  the  observed  data.  Each  simulation  is  distinguished  by  a 
letter  suffix,  a,  b,  or  c,  to  the  case  number  in  Appendix  D. 
The  starting  seed  used  each  time  was  the  ending  seed  value 
from  the  previous  run.  This  insured  that  each  run  would  be 
independent  [Ref.  5]. 

The  demonstrated  accuracy  of  the  estimation  procedure 
can  be  measured  in  terms  of  the  difference  between  the 
100  (1-a)  percentile  of  the  simulation  results,  r"*o,  and  the 
true  system  reliability,  Rs.  This  difference,  labeled  D  in 
the  output  tables,  is  defined  as  follows: 

D  =  R*o  -  Rs  (4.1) 

As  mentioned  in  Section  III. A,  the  absolute  value  of  D 
should  be  small  and  reflect  a  conservative  error.  This 
desired  conserve tivism  is  satisfied  so  long  as  the  sign  of  D 
is  negative.  Otherwise  the  lower  confidence  limit 
estimation  procedure  would  yield  overly-optomistic  estimates 
and  could  not  be  a  valid  vehicle  for  the  description  of 
system  reliability.  The  one  instance  where  this  condition 
was  not  satisfied  occurred  in  Case  13c.  However,  the  value 
of  D  was  extremely  small,  represented  less  than  one-half  of 
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one  percent  error,  and  differed  from  the  conservative 
results  of  the  other  runs  by  less  than  one  percent. 

It  should  also  be  noted  that  the  distributions  of  the 

^  ^  AS 

estimates  Ti,  S,  and  r  are  discrete  in  nature  and  the  values 
are  determined  by  the  number  and  arrangement  of  components 
and  the  number  of  component  tests.  Estimates  based  upon  few 
failures  will  exhibit  the  most  highly  discrete  sample 
distribution  scheme.  The  effect  of  this  discreteness  will 
generally  be  to  increase  the  observed  error  magnitude  unless 
some  form  of  continuity  correction  can  be  developed. 


B.  ANALYSIS  OF  RESULTS 


1 .  General  Characteristics 


The  simulation  output  for  Cases  One  through  Twelve 
was  expanded  to  include  the  complete  ordered  arrays  of 
estimated  confidence  limit  values  in  order  to  establish  the 
nature  of  the  sample.  Some  properties  were  evident  from 
inspection.  The  samples  were  unimodal  and  discrete,  as 
expected.  Discreteness  was  most  pronounced  in  the  higher 
valued  estimates.  The  sample  distribution  appeared  nearly 
symmetric  and  this  supposition  was  checked  by  comparing  the 
sample  mean  and  median  values  and  also  by  plotting 
complementary  quantiles.  The  first  test  showed  very  close 
agreement  throughout.  The  second  test  indicated  that  only 
minor  left  skewness  exists  in  most  cases.  Skewness  seemed 
more  pronounced  for  higher  values  of  system  reliability,  as 
might  be  expected  might  bo  suspected,  since  the  distribution 
is  bounded  by  an  upper  estimate  value  of  1.0. 

The  shape  of  the  distribution  was  further  described 
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by  examining  the  ratio  of  the  interguartile  range  divided  by 
the  interdecile  range  and  comparing  it  with  the  same  ratio 
from  the  Normal  distribution  which  is  about  0.526.  The 
observed  values  were  generally  on  the  order  of  0.50  which  is 
in  good  agreement  considering  the  discrete  nature  of  the 
sample  distribution.  Systems  designed  with  high  reliability 
coupled  with  insufficient  testing,  such  as  Cases  18  and  19, 
exhibited  great  variations  in  the  ratio,  from  0.2  to  1.0, 
due  to  the  sparcity  of  different  sample  values  occuring  in 
the  pronouncedly  discrete  sample  distribution. 

Another  useful  measure  of  shape  is  the  sample 
standard  deviation.  It  is  particularly  helpful  in 
quantifying  the  spread  of  the  data  in  terms  of  the  units  of 
measure.  The  preceeding  ratio,  on  the  other  hand,  was 
independent  of  the  units.  The  sample  standard  deviation, 
however,  gives  no  indication  of  skewness  nor  the 
discreteness  of  the  underlying  distribution.  The  standard 
deviation  is  most  useful  when  these  higher  order  effects  are 
small. 


The  ability  to  predict  the  standard  deviation  from 
the  test  pl^n  an^,  system  design  parameters  would  provide  an 
additional  measure  of  the  system  reliability.  This  concept 
evolves  from  a  consideration  of  the  100 (1-a)  percent  lower 
confidence  limit.  Of  itself,  it  tells  us  only  that  there  is 
a  (1-a)  probability  that  the  true  system  reliability  is 
greater  than  a  particular  value.  The  standard  deviation  of 
the  estimate  of  this  confidence  limit  can  provide  a  feel  for 
how  much  the  true  system  reliability  might  vary  from  the 
estimate.  For  example,  given  an  eighty  percent  lower 
confidence  limit  of  0.78  and  a  predicted  standard  deviation 
of  the  estimate  of  0.005,  we  can  feel  fairly  certain  that 
the  true  system  reliability  does  not  exceed  0.82.  However, 
had  the  standard  deviation  been  0.01  or  0.02,  there  would  be 
increasing  uncertainty  about  the  range  of  likely  values  of 
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true  reliability.  Therefore,  the  sample  standard  deviation 
has  been  included  in  the  regression  section  later  in  this 
chapter  in  an  effort  to  not  only  predict  procedure  accuracy, 
but  also  estimate  spread. 


2 •  Derivation  and  Discussion  of  TT 


Previous  tests  of  the  original  Log-Gamma  procedure 
have  indicated  that  the  quantity 

k 

TT  =  I  (Ni)  (Qi)  (4.2) 
i=l 

could  be  used  as  an  indicator  of  relative  accuracy  of  the 
procedure,  where  Ni  is  the  number  of  mission  tests  performed 
upon  the  i-th  component  and  Qi  is  the  design  or  expected 
unreliability  goal  for  the  i-th  component  [Ref.  1].  The 
quantity  determined  in  this  manner  was  the  total  amount  of 
testing  relative  to  the  component  unreliabilities,  or, 
approximately,  the  expected  number  of  test  failures  summed 
over  all  components  and  tests. 

A  similiar  measure  was  sought  for  the  revised 
procedure  examined  in  this  paper.  However,  a  simple 
expression,  such  as  equation  (4.2),  could  not  be  directly 
applied  to  the  mixed  series-parallel  system.  If  the 
equation  were  used,  it  could  lead  to  extremely  large  values 
of  TT,  since  the  parallel  components  would  tend  to  dominate 
the  sum.  This  is  reasonable  to  expect,  since  the  components 
connected  in  parallel,  taken  individually,  would  tend  to 
have  greater  unreliability  than  the  series  components. 

The  first  revised  equation  proposed  for  TT  can  be 
used  whenever  all  components  within  each  parallel  subsystem 
are  given  identical  numbers  of  mission  tests. 
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TT 


(4.3) 


K1  K1+K2 

=  .E  (Ni)  (Qi)  +  .  Z  (Ni*)  (Qi*) 

1=1  1=K1+1 

where  K1  is  the  number  of  series  components  in  the  system 

K2  is  the  number  of  series- parallel  subassemblies 

connected  in  logical  series  in  the  system 

Ni,  Qi  are  defined  as  above. 

Ni*  is  the  common  number  of  tests  given  each  component 
in  the  i-th  subassembly. 

Qi*  is  the  unreliability  of  the  i-th  subassembly 
computed  from  its  component  unreliability  goals  using 
standard  series-parallel  reliability  computation  techniques. 

Equation  (4.3),  in  effect,  reduces  each  subassembly 
to  an  equivalent  *  pseudo-component '  connected  in  series  in 
the  system.  The  quantity  TT  is  now  approximately  equal  to 
the  expected  number  of  system-affecting  failures  summed  over 
all  components,  subassemblies,  and  tests.  However,  the 
drawback  of  this  equation  is  the  necessity  of  testing  all 
components  within  a  subassembly  an  identical  number  of 
times.  It  would  seem  unnecessarily  restrictive  to  conduct 
the  same  number  of  tests  on  a  medium  reliability  component 
and  on  a  high  reliability  component  just  to  satisfy  the 
equation . 

Therefore  an  alternate  formulation  for  the  term 
(Ni*)  (Qi*)  was  sought  which  would  provide  a  meaningful 
measure,  and  yet  would  allow  unequal  amounts  of  testing 
within  subassemblies.  The  following  ad  hoc  formulation  is 
proposed ; 

Each  wholly  series-connected  branch  within  a 
subsystem  will  first  be  reduced  to  an  equivalent  single 
component  by  the  following  formula 

I  (Ni)  (1-ei) 
ie  B 

Nb  - -  (4.4) 

1  -  Rb 
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where  Rb  is  the  classically  determined  branch  reliability 

goal  Rb  =  n  Ri  for  series-connected  components. 
i€  B 

Ri  is  the  reliability  goal  of  the  i-th  component. 

B  is  the  set  of  all  components  in  the  branch. 

Nb  represents  an  "equivalent"  number  of  branch  tests 
(need  not  be  integer)  . 

The  series-connected  branch  is  replaced  in  the 
remaining  computations  by  a  single  equivalent  component  with 
reliability  goal  Ri  =  Rb  and  number  of  mission  tests  Ni  = 
Nb. 


After  all  wholly  series-connected  branches  have  been 
reduced  in  this  manner,  each  wholly  parallel-connected 
branch  in  the  revised  subassembly  is  reduced  to  an 
equivalent  component  in  the  following  manner: 

Compute  the  equivalent  reliability  goal 

Rb  =  1  -  n  (1-Ri) 
i^B 

in  the  usual  manner. 


The  number  of  possible  combinations  of  individual 

test  results  for  the  branch  components  is  n  Ni  which  is 

i€B 

set  equal  to  the;  same  number  of  possible  combinations 

obtained  if  each  component  had  been  tested  Nb  times.  Thus 
the  equivalent  number  of  mission  tests,  Nb,  is  computed  as 
the  geometric  mean  of  the  component  tests 


Nb  = 


=  f  n  Nil 
lie  B  J 


l/m 


The  above  procedure  is  repeated  until  the  entire 
subassembly  is  reduced  to  a  single  equivalent  component,  i'. 
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with  its  equivalent  number  of  mission  trials,  Ni* ,  and 
equivalent  unreliability  goal,  Qi*  =  l-Ri*.  TT  may  then  be 
computed  as  before: 

K1  K1+K2 

TT  =  .2  (Ni)  (Qi)  +  .  2^  (Ni*)  (Qi*)  (4.3) 

1=1  1=K1+1 


3 .  Accuracy  Prediction 


Appendix  E  contains  the  equations  and  methodology 
used  to  attempt  to  relate  the  accuracy  measure,  D,  and  the 
estimate  standard  deviation  to  the  quantity  TT.  The 
principal  conclusion  to  be  drawn  from  the  results  is  that 
accuracy  is  a  predictable  quantity  only  with  respect  to 
particular  system  configurations  for  which  models  have  been 
generated  and  tested  as  in  this  paper.  Accuracy  seems  an 
unstable  variable  from  configuration  to  configuration, 
although  it  appears  to  be  fairly  well  behaved  within  any  one 
configuration. 

V 

With  respect  to  the  estimate  standard  deviation,  the 
value  appears  to  be  related  more  to  the  number  of  component 
tests  than  to  the  expected  number  of  system  affecting 
failures.  Reduction  in  the  magnitude  of  the  standard 
deviation  by  about  0.01  appears  to  require  alomst  double  the 
number  of  component  tests.  However,  the  magnitudes  are 
generally  less  than  0.07  for  component  test  sample  sizes  of 
20  or  more.  The  standard  deviation  values  also  appear  to  be 
fairly  insensitive  to  changes  in  system  configuration. 

4 .  Comparison  with  Earlier  Results. 

Cases  13  through  20  were  taken  from  Ref.  1  in  order 
to  provide  a  basis  for  checking  relative  accuracy  when 
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extending  the  Log-gamma  procedure  beyond  simple  series 
systems.  Unfortunately,  an  apparent  shortcoming  of  the 
original  simulation  makes  the  1968  data  suspect. 

The  original  results  tended  to  be  too  optimistic  for 
those  cases,  in  particular,  where  the  number  of  component 
tests  was  moderately  low  and  the  true  component 
reliabilities  were  high.  Significantly  nigh  estimates  at 
the  100  (1-a)  percentile  were  observed  in  the  cases 
corresponding  to  Cases  13,  15,  18,  19,  and  20  of  the  present 
study.  Although,  on  this  basis,  the  comparison  is  very 
favorable  to  the  present  procedure,  it  is  thought  that  the 
original  simulation  results  are  in  error  with  respect  to  the 
procedure.  Reference  1  does  not  specifically  identify  the 
random  number  generator  used,  however  some  uniform  random 
variate  generators  do  not  perform  well  for  very  small  or 
very  large  numbers  near  the  boundaries,  such  as  would  be 
encountered  in  the  simulation  procedure  used  in  the  original 
study.  The  present  simulation  binomial  random  variate 
generator  was  tested  prior  to  use  to  insure  proper 
performance  throughout  the  range  of  simulation  values  used. 

Of  the  remaining  cases  (14,  16,  and  17)  the  original 
results  were  much  closer  to  the  true  system  reliability  in 
the  first  two  cases  and  comparable  in  the  last  case. 
However,  these  results  cannot  be  considered  meaningful  in 
light  of  the  suspected  problems  with  the  random  number 
generator. 


In  addition,  many  instances  of  cases  found  in  Ref.  1 
had  prima-facia  unreasonable  results  for  the  100  (1-a) 
percentile  values,  in  that  they  were  considerably  higher 
than  the  upper  bound  imposed  by  the  zero-failure,  binomial 
system  test  treatment  discussed  in  Appendix  C. 

Another  difference  between  the  original  study  and 
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the  present  one  is  the  use  of  an  arbitrary  continuity 
correction  in  the  earlier  procedure.  This  could  also  have 
been  a  contributor  to  the  excess  optimism  in  the  reported 
simulation  results. 

In  light  of  the  foregoing  paragraphs,  no  comparison 
with  the  results  of  this  study  was  deemed  worthwhile. 


C.  CONCLUSIONS 


The  primary  conclusion  to  be  drawn  from  this  study  is 
that  the  Log-gamma  lower  confidence  level  procedure  for 
series-parallel  systems  can  be  accurate.  How  accurate  it 
will  be  in  any  specific  application  is  a  function  of  the 
magnitude  of  the  component  testing  program,  the  individual 
component  reliabilities,  and  the  complexity  of  the  system. 
In  addition,  of  course,  the  validity  of  the  assumptions 
concerning  component  interaction  and  mission  environment 
will  also  hear  directly  upon  the  accuracy  of  any  procedure 
which  purports  to  estimate  system  mission  reliability  from 
component  test  results.  The  effects  of  these  assumptions, 
however  will  be  controlled  by  the  proper  design  of  the 
component  test  procedures  and  are  not  addressed  in  this 
study. 

For  the  cases  considered  the  Log-gamma  procedure  tends 
to  be  conservative,  which  is  necessary  if  one  takes  the 
position  that  pleasant  surprises  with  better  than  expected 
performance  cost  less  than  unpleasant  surprises  in  the  form 
of  degraded  demonstrated  reliability.  Of  course,  too  much 
underestimation  of  system  reliability  could  drive  up  the 
development  costs  in  an  unnecessary  search  for  a  much  more 
reliable  design. 
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The  accuracy  indicator  TT  developed  in  Section  IV. B. 2 
can  be  used  as  a  rough  gauge  of  expected  procedure  accuracy. 
The  following  scheme  is  suggested  for  minimum  values  of  TT 
for  fairly  good  expected  accuracy: 

Approximate 

Order  of  a  =  0.20  a  =  0.10  a  =  0.05 

Accuracy 

0.02  6.1  12.8  19.2 

0.01  11.7  23.6  32.6 

However,  since  procedure  accuracy^  is  so  demonstrably 
sensitive  to  variation  in  the  system  configuration,  the  best 
approach  prior  to  use  of  the  Log-gamma  procedure  is  to 
perform  a  simulation  as  described  in  Section  III. A  for  the 
particular  system  design  to  be  exercised.  Such  a  simulation 
could  be  used  to  evaluate  many  different  combinations  of 
component  test  plans  and  also  support  the  claimed  accuracy 
of  the  lower  confidence  limit  derived  from  the  adopted  test 
plan  results.  The  investment  in  such  a  simulation  effort 
should  not  be  excessive  from  the  standpoint  of  computer 
time,  since  the  most  complex  cases  examined  in  this  study 
required  less  than  five  minutes  of  Central  Processor  Unit 
(CPU)  time  from  start  to  end.  Without  the  support  of  such  a 
simulation  specific  to  the  system,  the  accuracy  of  the 
procedure  can  be  predicted  only  very  approximately. 

For  extremely  reliable  systems,  for  which  few  failures 
are  expected  with  large  amounts  of  testing,  the  binomial 
lower  confidence  limit  procedure  developed  in  Appendix  C 
might  provide  the  desired  magnitude  of  the  lower  confidence 
limit  without  the  extra  testing  required  to  achieve  the 
desired  accuracy  of  the  Log-gamma  procedure.  In  fact,  for 
cases  of  one  failure  or  less,  the  binomial  procedure  is 
probably  preferable  on  the  basis  of  both  theoretical  rigor 
and  ease  of  computation. 
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Finally,  the  matter  of  a  continuity  correction  should  be 
investigated.  An  appropriately  determined  continuity 
correction  procedure  could  conceivably  reduce  the  component 
testing  reguirements  for  the  same  expected  procedure 
accuracy . 
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APPENDIX  A 


DERIVATION  OF  UNBIASED  ESTIMATE  FOR  Ti 


For 

Ti  =  Qi  +  Qi2/2 

an  unbiased  estimator  is  desired,  based  upon  the  component 
failure  data.  Let  Fi  be  the  number  of  failures  observed  in 
Ni  mission  tests  on  the  i-th  component.  The  expected  value 
of  Fi  is  NiQi  and  an  unbiased  estimator,  Qi,  for  Qi  is 
Fi/Ni,  where  Fi  is  binomially  distributed  with  parameters  Qi 
and  Ni;  Qi  =  1-Ri;  and  Ri  is  the  true  reliability  of  the 
i-th  component. 

An  estimator,  Ti,  for  Ti  will  be  chosen  of  the  form 

Ti  =  Ai[Qi]  +  Bi[Qi2]/2  (A.1) 

and  the  constants  Ai  and  Bi  chosen  so  as  to  make  the 
estimator  unbiased,  that  is  the  expected  value  of  Ti  is 
equal  to  Ti, 

B[Ti]  =  Ti  =  Qi  +  Qi2/2  (A.  2) 

=  AiECQi]  +  (Bi/2)E[Qi2] 

=  (Ai/Ni)E[Fi]  +  (B/2Ni2)  E[  Fi2  ] 

=  (Ai/Ni)  [  NiQi  ] 

+  (Bi/2Ni2) [ NiQi-NiQi2+Ni2Qi2 ] 

=  AiQi  +  BiQi/2Ni  -  BiQi2/2Ni  +  BiQi2/2 

=  [  Ai  +  Bi/2Ni]Qi  +  [Bi/2  -  Bi/2Ni]Qi2  (A.  3) 
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Equating  equation  (A.  3)  term  by  term  with  equation  (A.  2) 
yields  the  following  two  equations 

Ai  +  Bi/2Ni  =  1 

and  Bi  -  Bi/Ni  =  1 

which  reduce  to  expressions  for  the  unbiased  estimator 
constants: 

Ai  =  (2Ni-3)/(2Mi-2)  (A, 4) 

and  Bi  =  Ni/(Ni-1)  (A. 5) 


39 


APPENDIX  B 


APPROXIMATION  0?  Var[ Ti ]  BY  Ti/Ni 


A.  DERIVATION  OF  Var[Ti] 


The  variance  of  Ti  is  derived  as  follows: 
From  appendix  A, 


Ti  =  AiQi  +  (BiQi2)/2 

(B.1) 

thus. 

'ti2  =  Ai2Qi2  +  AiBiQi3  +  (Bi2Qi4)/4 

(B.2) 

Var[Ti]  =  ErTi2]  -  E2[Ti] 

(B.3) 

=  ECfi2]  -  Ti2 


=  ^(Ai2/Ni2)  E£Fi2  ]  +  (AiBi/Ni3)  E[  Fi3  ] 

+  (Bi2/4Ni*)  E[Fi^  ] 

-  [  Qi2  +  Qi3+ (Qi4/4)  ]  (B.4) 

Using  the  moment  generating  functions  for  the  binomially 


distributed  variable  Fi,  with  parameters  Qi  and  Ni,  yields 

E[  Fi]  =  NiQi  (3.5) 

E[Fi2]  =  NiQi  +  NiQi2(Ni-1)  (B.6) 

E[Fi3]  =  NiQi  +  NiQi2  (Ni-1)  [  3  +  Qi  (Ni-2)  ]  (B.7) 

EfFi^]  =  NiQi^(Ni-l)  (Ni-2)  (Ni-3)  +  7NiQi2  (Ni-1) 

+  6NiQi3  (Ni-1)  (Ni-2)  +  NiQi  (B.3) 
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Substituting  the  jnoment  equations  (B.5)  through  (B.8) 
into  equation  (B.4)  and  simplifying  the  resulting  expression 
yields  the  following  equation  for  the  variance  of  Ti: 


4Ni2-3Ni+1  3Ni-4 

Var[Ti]  =  Qi  +  r-v 


4Ni  (Ni-1)  2 
1 


2Ni(Ni-1) 
2Ni-3 

Qi^  — — r-T  Qi* 


Ni-I  2Ni(Hi-1) 

or,  in  terms  of  Ai,  Bi,  Ni,  and  Qi: 

Bi2  +  2Ni2Bi  (Ai+Bi)  2Ai+1 

7ar[Ti]  =  - - -  Qi  +  — r— : —  Qi^ 


(B.9) 


4Ni3 

Bi  Ai 

-  —  Qi3 - Qi* 

Hi  Ni 


2Ni 


(B. 10) 


To  test  the  approximation  of  Var[fi]  by  Ti/Ni,  equation 
{B.9)  was  solved  with  representative  valures  of  Qi  and  Ni 
and  compared  with  E[Ti]/Ni.  The  percent  error  of  the 
approximation  was  computed  for  each  value  and  is  given  in 
table  B-1.  As  expected,  increasing  Ni  or  decreasing  Qi 
improves  the  accuracy  of  the  approximation. 


By  way  of  comparison,  table  B-2  shows  the  relative 
accuracy  of  this  same  approximation  when  Ti  is  defined  as 
the  first  three,  vice  two,  terms  of  the  logarithmic  series 
expansion  of  S  [Eg.  (2.3)  ].  In  this  case  the  unbiased 
estimator  for  Ti  will  be 


Ti  =  Ai'Qi  +  Bi»Qi2/2  +  Ci'Qi3/3  (B. 11) 

where  _  6  (Ni- 1)  (Ni-2) -3  (Ni-4) -2 

6  (Ni-1)  (Ni-2) 

Ni (Ni-4) 

Bi*  =  - 

(Ni-1)  (Ni-2) 

Ni2 

Ci*  = - 

(Ni-1)  (Ni-2) 
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Qi 

Ni  =  10 

Ni  =  50 

Ni  =  100 

0.001 

-5.08% 

-1.10% 

-0.60% 

0.003 

-5.25% 

-1  .29% 

-0.79% 

0.006 

-5.52% 

-1.58% 

-1.09% 

0.01 

-5.87% 

-1.96% 

-1.47% 

0.03 

-7.50% 

-3.73% 

-3.26% 

0.06 

-9.64% 

-6.07% 

-5.62% 

0.10 

-12.0% 

-8.65% 

-8.23% 

0.20 

-15.8% 

-12.9% 

-12.5% 

0.30 

-17.0% 

-14.4% 

-14.1% 

0,40 

-15.8% 

-13.4% 

-13.1% 

0.50 

-12.0% 

-9.67% 

-9.38% 

0.60 

-4.77% 

-2.40% 

-2.11% 

0.70 

+7.70% 

+10.3% 

+10.6% 

Table  B-1 .  ^rror  Percentage  of  approximation 
for  Var[Ti]  Osing  Two-term  Form  of  Ti. 


Qi 

Ni  =  10 

0.001 

-0.06% 

0.003 

-0.17% 

0.006 

-0.33% 

0.01 

-0.56% 

0.03 

-1.68% 

0.06 

-3.36% 

0.10 

-5.57% 

i  =  50 

Ni  =  100 

-0.05% 

-0.05% 

-0.15% 

-0.15% 

-0.31% 

-0.30% 

-0.51% 

-0.51% 

-1.54% 

-1.53% 

-3.09% 

-3.06% 

-5.11%  -5.06% 

Table  B-2.  ^Error  Percentage  of  approximation 
for  Var[Ti]  Osing  Three-term  Form  of  Ti. 


Due  to  time  constraints  and  the  general  acceptability  of 
the  values  noted  in  table  B-1,  the  use  of  the  more  complex 
definition  of  Ti  was  left  for  future  study.  However,  figure 
B-1  plots  the  accuracy  as  a  function  of  Qi,  Ni,  and  form  of 
Ti. 
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8% 


Figure  B-1.  PERCENTAGE  ERROR  OF  APPROXIMATION  FOR  yAR[Ti] 
VS.  COMPONENT  ONRELIABILITY. 
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APPENDIX  C 


SPECIAL  CONSIDERATIONS  WHEN  S  EQUALS  ZERO 


When  all  components  have  completed  the  course  of  mission 
tests  and  no  failures  have  been  observed  along  some 
reliability  path  through  the  system,  the  estimator  §  will 
equal  zero.  This,  in  turn,  will  result  in  the  log -gamma 
lower  confidence  limit  estimate  being  equal  to  one  unless 
the  procedure  is  modified  to  include  some  "virtual”  or 
"pseudo"  test  failure  value  for  the  computations  when  this 
occurs.  The  alternative  is  to  seek  some  other  lower 
confidence  limit  procedure  which  applies  with  zero  failures. 
Such  an  alternative  is  also  suggested  below. 


For  simplicity,  assume  all  series  components  and 
subassemblies  have  been  subjected  to  an  equal  number  of 
mission  trials,  N,  without  failure.  This  may  be  thought  of 
as  equivalent  to  conducting  N  mission  trials  on  the  system 
without  failure,  subject  to  the  usual  assumptions  concerning 
test  environment  and  component  interaction  effects.  When 
unequal  numbers  of  component  trials  are  involved,  the 
conservative  course  of  action  is  to  choose  N  equal  to  the 
smallest  of  the  component  trial  values. 


Now  the  number  of  system  mission  trial  successes,  W,  can 
be  related  to  system  mission  reliability,  Rs,  by  the 
binomial  distribution  formula 


N  /  N  \  j 


Prob(#  successes  >  W)  (C.1) 


44 


where  N 


number  of  mission  trials 


The  100(1-a)?5  Lower  Confidence  Limit  Estimate  for  system 
reliability  would  then  be  the  solution  for  R*  in  the 
following  formula: 


(H*)  (1 


(C.2) 


which,  when  H  =  N,  reduces  to 


N 

(R*)  =  a  or  R* 


1/N 
(  “  ) 


This  result  may  then  be  substituted  into  the  Log-gamma 
procedure  formula  for  R*<  a)  and  solved  for  the  number  of 
equivalent  component  failures  which  would  yield  the  same 
estimate  of  system  reliability. 


R*(a)  =  exp 


r-CSrlS  1  ^ 

[  ^[2f  ],1-a  J 


=  (  a  ) 


1/N 


where 


K  . 

S  =  Z  Ti 
i=1 


r  =  max 


.0, 


■  K 

Z  Ti 
i=1 


K  Ti 
Z  — 
i=1  Ni 


(C.3) 


which  reduce  to  S  =  fi  and  r  =  max[  1 ,  (Ni)  (Ti)  ],  since  only 
one  component  or  subassembly  will  make  a  non-zero 
contribution  to  the  sums. 

Now,  if  r  =  1.0,  then  (Ni)  (fi)  <  1.0  and  fi  <  1/Ni. 

Also  recall  that 


where 


fi 


Ai 


(Ai)  (Qi)  +  (Bi/2)  (Qi2) 

2Ni  -  3  .  Ni 

■  ,  B  i  —  , 

2  (Ni-1)  Ni  -  1 


Qi  = 


Fi 

Ni 


(2.5) 
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Or,  equivalently. 


(Bi/2Ni2)  (Fi2)  +  (Ai/Ni)  (Fi)  -  Ti  =  0  (C.4) 

Substituting  for  Ai,  Bi  and  the  earlier  inequality  for  Ti, 


Ni 


l2  (Ni-1)  (Ni2] 
which  reduces  to 


(Fi2)  + 


2Ni-3 


2  (Ni-1)  (Ni) 


1 

(Fi)  -  —  <0 
Ni 


Fi2  +  (2Ni-3)  Fi  -  2  (Ni-1)  <  0 
which,  in  turn,  can  be  factored  as 


(Fi  -  1)  [Fi  +  2  (Ni-1)  ]  <  0 


(C.5) 


The  only  positive  values  for  Fi  which  can  satisfy  this  last 
equation  are  Fi  less  than  or  equal  to  one.  This  means  that 
for  any  size  Ni,  the  value  of  [2r]  will  be  two.  We  can  now 
solve  the  reliability  estimate  equation  for  Fi*,  the  number 
of  equivalent  failures  for  the  Log-gamma  method. 


r  -C2r]  S 
exp  I - - - 


=  (  a  ) 


1/N 


{C.6) 


S  = 


V2 

/<-2,  1-0 

2N 


Ai(Fi*)  Bi(Fi*)2 
(In  a)  =  - - -  +  — — - (C.7) 


N 


2N2 


which  reduces  to 

Fi*2  +  (2N-3)  Fi*  +  (N 


-1)  (In  a  )  [y  2,1-a  =  0  (C. 


8) 


This  quadratic  may  be  solved  for  Fi*  as  a  function  of  N 
and  a.  The  results  are  listed  in  table  C-1.  From  the 
table,  choosing  Fi*  at  the  N  =  10  level  will  be  conservative 
for  all  N  greater  than  10,  yet  will  yield  relatively 
accurate  results  for  all  larger  N  due  to  the  slow  rate  of 
change  of  Fi*  with  respect  to  N. 
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N 

a=0 . 2 

a=0.1 

a  =  .05 

5 

0.3888 

0.2670 

0. 1713 

10 

0.3721 

0.2531 

0.1610 

20 

0.3652 

0. 2475 

0.1570 

100 

0.3603 

0. 2435 

0. 1542 

1000 

0i3593 

0.2427 

0.1536 

Table  C-1.  Solution  for  Fi*  with 
Various  N  and  a  Values. 
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APPENDIX  D 


TABULATED  SIMULATION  RESULTS 


The  following  pages  contain  two  tables  listing  the 
principal  simulation  output  data.  The  tables  are  presented 
concurrently  for  each  case,  one  case  per  page.  The  cases 
are  listed  in  alpha-numeric  order.  The  following  list  of 
terms  applies: 

Case;  The  case  number  as  explained  in  Section  III.B.  The 
letter  suffix  distinguishes  between  different  runs  of 
the  same  case  using  different  seeds  for  the  binomial 
random  variate  generating  function. 

KK:  The  total  number  of  components  in  the  system. 

TT:  The  accuracy  indicator  as  discussed  in  seciton  IV. B. 

TM:  The  modified  accuracy  indicator  described  in  Appendix 

E. 

Rs:  True  system  reliability. 

CL:  Confidence  Level,  CL  =  100  (1-a)  . 

R*®:  The  100  (1-a)  percentile  of  the  simulation  estimates  of 

the  100  (1-a) %  lower  confidence  limit  for  system 
reliability . 

D:  The  primary  accuracy  measure.  As  discussed  in  Section 

IV. A,  D  =  li*®  -  Rs. 

Mean:  The  sample  mean  of  the  estimates. 

S.D.:  The  sample  standard  deviation  of  the  estimates. 
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Null  Runs;  The  number  of  runs  which  occured  during  the 
simulation  for  which  S  equalled  zero.  Refer  to 
sections  II. C  and  III. A  and  Appendix  C  for  further 
elaboration . 
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Ola  32  2.67  1.73  0.8756  80.0  0.8206  -0.0550  0.7728  0.0668 
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Table  D-2.  Additional  Simulation  Output  (continued) 


07a  32  4.67  3.03  0.7917  80.0  0.7557  -0.0359  0.6850  0.0807 
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Table  D-2.  Additional  Simulation  Output  (continued) 


08a  32  11.7  7.57  0.7917  80.0  0.7788  -0.0129  0.7368  0.0520 
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Table  D-2.  Additional  Simulation  Output  (continued) 
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14a  15  4.40  3.14  0.7924  80.0  0.7561  -0.0363  0.6903  0.0758 
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Table  D-2.  Additional  Simulation  Output  (continued) 


15a  25  3.12  2.09  0.8822  80.0  0.8236  -0.0586  0.7790  0.0535 
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Table  D-2.  Additional  Simulation  Output  (continued) 


16a  25  6.25  4.18  0.8822  80.0  0.8699  -0.0123  0.8285  0.0457 
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Table  D-2.  Additional  Simulation  Output  (continued) 
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18a  25  0.62  0.42  0.9753  80.0  0.8359  -0.1394  0.8305  0.0195 
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Table  D-2.  Additional  Simulation  Output  (continued) 
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21a  25  5.00  3.34  0.9753  80.0  0.9711  -0.0042  0.9603  0.0158 
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Table  D-2.  Additional  Simulation  Output  (continued) 


22a  60  2.70  1.62  0.8731  80.0  0.8262  -0.0469  0.7790  0.0679 
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Table  D-2.  Additional  Simulation  Output  (continued) 


23a  60  3.37  2.02  0.8731  80.0  0.8410  -0.0321  0.7942  0.0570 
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Table  D-2.  Additional  Simulation  Output  (continued) 


24a  60  6.75  4.04  0.8731  80.0  0.8640  -0.0091  0.8260  0.0442 
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Table  D-2.  Additional  Simulation  Output  (continued) 


25a  60  13.5  8.09  0.8731  80.0  0.8679  -0.0052  0.8411  0.0324 
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Table  D-2.  Additional  Simulation  Output  (continued) 


26a  60  3.58  2.14  0.8329  80.0  0.7999  -0.0330  0.7462  0.0671 
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Table. D-2.  Additional  Simulation  Output  (continued) 


27a  60  4.47  2.68  0.8329  80.0  0.8104  -0.0226  0.7572  0.0615 
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Table  D-2.  Additional  Simulation  Output  (continued) 
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Table  D-2.  Additional  Simulation  Output  (continued) 


29a  60  17.9  10.7  0.8329  80.0  0.8269  -0.0060  0.8002  0.0326 
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Table  D-2.  Additional  Simulation  Output  (continued) 
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Table  D-2.  Additional  Simulation  Output  (continued) 


33a  25  5.00  3.34  0.9753  80.0  0.9711  -0.0042  0.9605  0.0160 
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Table  D-2.  Additional  Simulation  Output  (concluded) 


APPENDIX  E 


REGRESSION  OF  OBSERVED  ACCURACY 


Examination  of  the  tabulated  data  in  Appendix  D  suggests 
that  a  linear  relationship  is  not  directly  applicable  to 
regression  of  the  accuracy  measure,  d,  on  any  of  the  other 
variables.  The  terms  IT,  developed  in  section  17. B. 2,  and 
KK,  the  number  of  components,  appear  to  be  the  most  likely 
candidate  independent  variables  for  the  model.  Plots  of 
these  terms  versus  D  suggest  that  an  exponential  decreasing 
or  inverse  power  curve  could  be  used  to  model  procedure 
accuracy  on  TT,  i.e. 

D  =  a*exp(b«TT)  (E.1) 
b 

D  =  a*TT  (B.2) 

where  a  and  b  are  appropriate  constants  from  the  underlying 
response  function.  Each  of  these  models  can  be  easily 
transformed  into  a  linear  model  by  taking  the  natural 
logarithm  and  redefining  variables  and  coefficients  where 
convenient. 

The  plots  indicate,  however,  that  the  system 
configuration  has  a  strong  effect.  Therefore,  curve  fitting 
will  be  initially  confined  to  similar  configurations  in  the 
following  groups:  Cases  01  to  12,  Cases  14  to  17,  and  Cases 
22  to  29.  Cases  1 8  to  21  will  be  considered  only  with 
reservations  due  to  the  artificial  bias  introduced  by  the 
particular  procedure  used  which  ignored  failureless  runs. 
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Cases  30  to  33  will  QOt  be  fitted  since  the  procedure 
employed  caused  the  sample  to  be  drawn  from  two  quite  unlike 
distributions  and  the  plots  demonstrated  an  apparent 
discontinuity  between  the  results  of  the  two  methods  (see 
Section  II. C  and  Appendix  C) .  Finally,  if  the  group  fits 
are  good,  a  composite  fit  will  be  attempted  for  Cases  01  to 
17  and  22  to  29.  This  fit  would  not  be  expected  to  be  good 
due  to  the  observed  inter-group  plot  variation. 


A.  EXPONENTIAL  CURVE  FIT 


Consider  the  linearized  exponential  model 
D'  =  A  +  b«TT 


(E.3) 


where  D'  =  In  (-D)  and  A  =  In  (-a)  .  From  the  Method  of  Least 
Squares,  expressions  for  A  and  b  can  be  derived  directly. 


b 


n  1  r  n  t  r  n 

Z  XT  D'  -  -  E  TT  I  D 
i=1  i  i  n  ‘-i  =  i  iJ  Li=i 

n  1  r  1 2 

z  TT2  -  -I  E  TT  1 
i=1  i  nLi=1  iJ 


1  r  n  1  br  n  t 

A  =  -j  E  D* I  -  -I  E  TT  I 
n‘-i=1  iJ  nLi=i  iJ 

and  the  coefficient  of  detersiination  [Ref.  6  ]  is 


1 

f  E  IT  D*  -  - 
[i=1  i  i  ni 

r 

[i£ 

1’ 

n  ^  r  1 

1  TT2  -  -  E  TT 
_i=1  i  n‘-i=i  iJ 

I’l 

dvll'l 

The  results  of  the  exponential  curve  fit  were  as 
follows: 
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Cases 

_0f_ 

_ a _ 

__b _ 

_ r2_ 

01-12 

.20 

-0.040 

-0.065 

0.690 

.10 

-0.094 

-0.076 

0.724 

.05 

-0.073 

-0.048 

0.738 

14-17 

.20 

-0. 118 

-0. 290 

0.942 

.10 

-0.301 

-0.282 

0.938 

.05 

-0.480 

-0.260 

0.988 

22-29 

.20 

-0.049 

-0.  156 

0.896 

.10 

-0. 153 

-0. 170 

0.899 

.05 

-0.346 

-0.216 

0.917 

B.  INVERSE  POWER  CORVE  FIT 

The  power  curve  may  be  linearized  to  the  form 

D'  =  A 

+  b«TT* 

(E.3) 

where  A  and  D' 

are  defined  as  before  and  TT*  =  In (TT) .  The 

coefficients,  A 

and  b,  and  the  coefficient 

of  determination 

may  be  found  as 

:  described  in  the 

preceding 

section  with  the 

substitution  of 

TT*  for  TT  where 

occuring . 

The  results 

of  the  power  curve  fit  were 

as  follows: 

Cases 

g  _ a _ 

__b _ 

_ r£_ 

01-12 

.20  -0.130 

-0. 868 

0.844 

.10  -0.368 

-1 . 016 

0.883 

.05  -0.780 

-1.  124 

0.893 

14-17 

.20  -0.664 

-2.085 

0.986 

.10  -1.589 

-2.016 

0.972 

.05  -2.110 

-1.828 

0.992 

22-29 

.20  -0.159 

-1.305 

0.989 

.10  -0.543 

-1.412 

0.977 

.05  -1.041 

-1 . 430 

0.980 

01-17 

.20  -0.136 

-1 . 060 

0.648 

22-29 

.10  -0.459 

-1.228 

0.793 

.05  -0.936 

-1.303 

0.845 

Comparing  these  results  with  those  of  the  exponential 
curve  fit  indicates  that  the  power  curve  provides  a  better 
fit  for  the  observed  simulation  data.  However,  the 
variation  in  the  coefficients  between  different  system 
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configurations  implies  that,  while  the  fit  may  be  good 
within  like  groups,  the  fit  is  much  more  approximate  across 
the  groups.  This  is  borne  out  by  the  composite  fit  listed 
last  in  the  preceding  table. 


C.  REGRESSION  OF  D  ON  TT  AND  KK 


For  this  regression  the  model  chosen  was  a  combined 
power  curve 

b  c 

D  =  a«TT  KK  (E.5) 

which  linearizes  to 

D'  =  A  +  b«TT'  +  c*KK'  (E.6) 

where  D' ,  A,  and  TT*  are  defined  as  before  and  KK'  =  In(KK). 


Solving  for  the  coefficient  values  by  the  Method  of 
Least  Squares  yields  the  following: 


rS1«S2 

I - 

•-  n 


T  j-S2«S3 

-  sen - -  S8  I  -  j  - 

J  L  n 


S2*S3 

I  -  j -  -  S7j  i - -  S4j 

J  i.  a  J  L  n  J 


c  = 


pSi  ^  1  rS3^  T  pS  1  •  S 3  1  2 

1 - 3411 - S5j  -  i - S8| 

L  n  J  L  n  J  L  n  •* 


S1*S2 


b  = 


I  pS  1  •  S3 

S6|  -  c| - S8| 

J  L  n  J 


po  I  • 

n 


S12 


n 


-  S4 


where 


r  1 

b 

c  n 

a 

=  expi-S2  - 

-SI  - 
n 

-S3 
n  J 

n 

n 

n 

SI 

II 

M 

S2 

=  ED' 

J) 

U) 

II 

i=1  i 

i=1  i 

i=1 

n 

n 

n 

S4 

_  j;  tT  '  2 

S5 

=  E  KK' 2 

S6  =  E 

i=1  i 

i=1  i 

i=1 
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SI 


=  I  fD'^KK'l 
i=1  ^  i  iJ 

From  the  data  for  cases  01 
the  following  values  for  a,  b, 

“  =  0.20  a  =  -0.080 

a  =  0. 10  a  =  -0.386 

a  =  0.05  a  =  -1.038 


and  S8  =  Z  [tT'  •KK'l 

i=1'-  i  iJ 

through  17  and  22  through  29, 
and  c  were  obtained: 


b  =  -1.028 

c  = 

0.129 

b  =  -1.200 

c  = 

0.033 

b  =  -1.279 

c  = 

-0.043 

An  approximate  coefficient  of  determination  was 
calculated  by  defining 

c/b 

TM  =  TT*KK 

so  that 


b 

D  =  a«TM 

which  is  the  inverse  power  curve  model  and  the  two  variable 
procedure  of  Section  B  can  be  used.  This  yielded  an  r^ 
value  of  0.626  for  a  =  0.2,  which  shows  no  improvement  of 
fit  for  the  three  variable  approach. 


Appendix  D  lists  TM  values  for  a  =  0.2  for  information. 


D.  REGRESSION  OF  STANDARD  DEVIATION 


Examination  of  the  sample  standard  deviation  values 
listed  in  Appendix  D  also  suggests  that  the  power  curve  form 
would  be  appropriate  to  model  the  standard  deviation  on  TT. 

b 

S.D.  =  a»TT 

Proceeding  as  in  Section  B,  the  following  values  are 
obtained : 
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a  = 

0.  20 

a  =  0.094 

b  =  -0.300 

r2 

=  0.523 

ot  = 

0.  10 

a  =  0.075 

b  =  -0.219 

=  0.374 

a  = 

0.05 

a  =  0.072 

b  =  -0.215 

r2 

=  0.408 

which  indicates  a  poor  fit  at  best. 

However,  the  data  suggests  that  the  sample  standard 
deviation  may  be  better  predicted  as  a  function  of  the 
number  of  component  tests,  i.e. 

b 

S.D.  =  a*N 

where  N  represents  the  '•equivalent”  number  of  system  tests 
as  derived  in  Section  IV. B. 2  for  use  in  Equation  (4.3)  . 


The  regression  yields  the  following  values: 


a  = 

0.20 

a 

=  0.213 

b  =  -0.391 

r2  =  0.853 

a  = 

0.  10 

a 

=  0.186 

b  =  -0.365 

r2  =  0.825 

a  = 

0.05 

a 

=  0.  164 

b  =  -0.339 

r2  =  0.799 

This  fit  is  better  and  implies  that  the  primary  mechanism  to 
reduce  the  sample  standard  deviation  is  to  increase  the 
number  of  component  tests.  As  the  data  base  is  limited, 
little  more  than  that  may  be  averred  at  this  level  of 
analysis . 
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APPENDIX  F 


COMPUTER  PROGRAM 


The  following  pages  contain  a  representative  listing  of 
the  main  computer  program  utilized  in  the  simulation.  Three 
proprietary  routines  were  used  for  binomial  random  variate 
generation  (GGBIN) ,  inverse  Chi-Square  value  determination 
(MDCHI) t  and  ordering  of  the  estimate  arrays  (VSORTA) . 
Reference  4  provides  information  concerning  the  contents  and 
use  of  these  routines.  Equivalent  routines  could  be  used 
without  penalty  to  either  accyracy  or  consistence  of  the 
simulation  results. 

The  program  was  written  in  the  FORTRAN  IV  language  for 
use  on  the  IBM-360  computer  system  installed  at  the  Naval 
Postgraduate  School. 

Portions  of  the  program  must  be  changed  as  the 
subassembly  configurations  are  varied  in  order  to  tailor  the 
computations  to  the  specific  system  being  modeled. 
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